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ABSTRACT 

We present the current accounting of systematic effect uncertainties for the Low Frequency Instrument (LFI) that are relevant to the 
2015 release of the Planck cosmological results, showing the robustness and consistency of our data set, especially for polarization 
analysis. We use two complementary approaches: (i) simulations based on measured data and physical models of the known systematic 
effects; and (ii) analysis of difference maps containing the same sky signal (“null-maps”). The LFI temperature data are limited by 
instrumental noise. At large angular scales the systematic effects are below the cosmic microwave background (CMB) temperature 
power spectrum by several orders of magnitude. In polarization the systematic uncertainties are dominated by calibration uncertainties 
and compete with the CMB E-modes in the multipole range 10-20. Based on our model of all known systematic effects, we show 
that these effects introduce a slight bias of around 0.2 cr on the reionization optical depth derived from the 70 GHz EE spectrum using 
the 30 and 353 GHz channels as foreground templates. At 30 GHz the systematic effects are smaller than the Galactic foreground at 
all scales in temperature and polarization, which allows us to consider this channel as a reliable template of synchrotron emission. 
We assess the residual uncertainties due to LFI effects on CMB maps and power spectra after component separation and show that 
these effects are smaller than the CMB amplitude at all scales. We also assess the impact on non-Gaussianity studies and find it to 
be negligible. Some residuals still appear in null maps from particular sky survey pairs, particularly at 30 GHz, suggesting possible 
stray light contamination due to an imperfect knowledge of the beam far sidelobes. 

Key words. Cosmology: cosmic background radiation - observations - Space vehicles: instruments - Methods: data analysis 


1. Introduction 

This paper, one of a set associated with the 2015 release of data 
from the Planck 1 mission, describes the Low Frequency Instru¬ 
ment (LFI) systematic effects and their related uncertainties in 
cosmic microwave background (CMB) temperature and polar¬ 
ization scientific products. Systematic effects in the High Fre¬ 
quency Instrument data are discussed in Planck Collaboration 
VII (2016) and Planck Collaboration VIII (2016). 

1 Planck (http://www.esa.int/Planck) is a project of the Euro¬ 
pean Space Agency (ESA) with instruments provided by two scientific 
consortia funded by ESA member states and led by Principal Investi¬ 
gators from France and Italy, telescope reflectors provided through a 
collaboration between ESA and a scientific consortium led and funded 
by Denmark, and additional contributions from NASA (USA). 


The 2013 Planck cosmological data release (Planck Collabo¬ 
ration I 2014) exploited data acquired during the first 14 months 
of the mission to produce the most accurate (to date) all-sky 
CMB temperature map and power spectrum in terms of sensitiv¬ 
ity, angular resolution, and rejection of astrophysical and instru¬ 
mental systematic effects. In Planck Collaboration III (2014) we 
showed that known and unknown systematic uncertainties are 
at least two orders of magnitude below the CMB temperature 
power spectrum, with residuals dominated by Galactic straylight 
and relative calibration uncertainty. 

The 2015 release (Planck Collaboration I 2016) is based on 
the entire mission (48 months for LFI and 29 months for HFI). 
For LFI, the sensitivity increase compared to the 2013 release is 
a approximately a factor of two on maps. This requires a thor- 
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ough assessment of the level of systematic effects to demonstrate 
the robustness of the results and verify that the final uncertainties 
are noise-limited. 

We evaluate systematic uncertainties via two complementary 
approaches: (i) using null maps 2 to highlight potential residual 
signatures exceeding the white noise. We call this a “top-down” 
approach; (ii) simulating all the known systematic effects from 
time-ordered data to maps and power spectra. We call this a 
“bottom-up” approach. This second strategy is particularly pow¬ 
erful, because it allows us to evaluate effects that are below the 
white noise level and do not show up in our null maps. Fur¬ 
thermore, it allows us to assess the impact of residual effects 
on Gaussianity studies and component separation. 

In this paper we provide a comprehensive study of the instru¬ 
mental systematic effects and the uncertainties that they cause on 
CMB maps and power spectra, in both temperature and polariza¬ 
tion. 

We give the details of the analyses leading to our results in 
Sects. 2 and 3 . In Sect. 2 we discuss the instrumental effects that 
were not treated in the previous release. Some of these effects are 
removed in the data processing pipeline according to algorithms 
described in Planck Collaboration II (2016). In Sect. 3 we as¬ 
sess the residual systematic effect uncertainties according to two 
complementary “top-down” and “bottom-up” approaches. 

We present the main results in Sect. 4, which provides an 
overview of all the main findings. We refer, in particular, to Ta¬ 
bles 5, 6 and 7 for residual uncertainties on maps and Figs. 24 
through 27 for the impact on power spectra. These figures con¬ 
tain the power spectra of the systematic effects and are often 
referred to in the text, so we advise the reader to keep them at 
hand while going through the details in Sects. 2 and 3. 

This paper requires a general knowledge of the design of the 
LFI radiometers. For a detailed description we recommend read¬ 
ing section 3 of Bersanelli et al. (2010). Otherwise the reader 
can find a brief and simple description in section 2 of Mennella 
et al. (2011). Throughout this paper we follow the naming con¬ 
vention described in appendix A of Mennella et al. (2010) and 
also available on-line in the Explanatory Supplement. 3 

2. LFI systematic effects affecting LFI data 

In this section we describe the known systematic effects affecting 
the LFI data, and list them in Table 1 . 

Several of these effects were already discussed in the context 
of the 2013 release (Planck Collaboration III 2014), so we do not 
repeat the full description here. They are: 

- white noise correlation; 

- 1//noise; 

- bias fluctuations; 

- thermal fluctuations (20-K front-end unit, 300-K back-end 
unit, 4-K reference loads); 

- so-called “1-Hz” spikes, caused by the housekeeping acqui¬ 
sition clock; 

- analog-to-digital converter nonlinearity. 

Here we describe effects that are either polarization-specific 
or that have been treated differently in this data release. These 
effects are: 

2 A null map is the difference between maps over time periods in which 
the sky signal is the same. See Sect. 3.3 

3 http://wiki.cosmos.esa.int/planckpla/index.php/Main_ 
Page 


- near sidelobes pickup; 

- far sidelobes pickup; 

- imperfect photometric calibration; 

- pointing uncertainties; 

- bandpass mismatch; 

- polarization angle uncertainties. 

Two other effects that are listed in Table 1 but are not dis¬ 
cussed in this paper are: (i) main beam ellipticity, and (ii) or¬ 
thomode transducer cross-polarization. The first is discussed in 
sections 5 and 6 of Planck Collaboration IV (2016). The second 
is negligible for LFI, as it is shown in section 4.1 of Leahy et al. 
( 2010 ). 

2.1. Optics and pointing 

2.1.1. Far sidelobes 

The far sidelobes are a source of systematic error because they 
pick up radiation far from the telescope line of sight and give rise 
to so-called “straylight contamination.” The LFI 30 GHz channel 
is particularly sensitive to the straylight contamination, because 
the diffuse Galactic emission components are rather strong at 
this frequency, and the far-sidelobe level of the 30 GHz beams is 
significantly higher compared to the other frequencies (for more 
details, see Sandri et al. 2010). The simulated pattern shown in 
Fig. 1 provides an example of the far sidelobes of a 70 GHz ra¬ 
diometer. The plot is a cut passing through the main reflector 
spillover of the Planck telescope 4 . 

Straylight impacts the measurements in two ways: it directly 
contaminates the maps; and it affects the photometric calibration. 
In the latter case, the straylight could be a significant fraction of 
the measured signal that is compared with the calibrator itself 
(i.e., the Dipole), causing a systematic error in the recovered cal¬ 
ibration constants. This error varies with time, depending on the 
orientation of the Galactic plane with respect to the line of sight. 

In the 2013 release we did not correct the LFI data for the 
straylight contamination and simply estimated the residual un¬ 
certainty in the final maps and power spectra (see table 2 and 
figure 1 of Planck Collaboration III 2014). 

In the CMB polarization analysis, instead, we accounted for 
this effect, both in the calibration phase and in the production of 
the calibrated timelines. This is particularly relevant at 30 GHz, 
while at 44 and 70 GHz the straylight spurious signal is small 
compared to the CMB, both in temperature and polarization (see 
the green dotted spectra in Figs. 24, 25 and 26). 

We perform straylight correction in two steps: first, we cali¬ 
brate the data, accounting for the straylight contamination in the 
sky signal; and then we remove it from the data themselves. To 
estimate the straylight signal, we assume a fiducial model of the 
sidelobes based on GRASP beams and radiometer band shapes, 
as well as a fiducial model of the sky emission based on simu¬ 
lated temperature and polarization maps. We discuss the details 
of these procedures in sections 7.1 and 7.4 of Planck Collabora¬ 
tion II (2016) and section 2 of Planck Collaboration V (2016). 

2.1.2. Near sidelobes 

The “near sidelobes” are defined as the lobes in the region of the 
beam pattern in the angular range extending between the main 
beam angular limit 5 and 5°(see Fig. 1) . We see that the power 

4 For the definition of the main- and sub-reflector spillovers refer to 
figure 7 of Planck Collaboration III (2014) 

5 The main beam is defined as extending to 1.9, 1.3, and 0.9° at 30, 44, 
and 70 GHz, respectively. 
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Table 1: List of known instrumental systematic effects in Planck- LFI. 


Effect 

Source 

Control/Removal 

Reference 


Effects independent of the sky signal (temperature and polarization) 


White noise correlation 

Phase switch imbalance 

Diode weighting 

Planck Collaboration III (2014) 

1 If noise 

RF amplifiers 

Pseudo-correlation and destriping 

Planck Collaboration III (2014) 

Bias fluctuations 

RF amplifiers, back-end electronics 

Pseudo-correlation and destriping 

3.2.5 

Thermal fluctuations 

4-K, 20-K and 300-K thermal stages 

Calibration, destriping 

3.2.4 

1-Hz spikes 

Back-end electronics 

Template fitting and removal 

3.2.6 


Effects dependent on the sky signal (temperature and polarization) 


Main beam ellipticity 

Main beams 

Accounted for in window function 

Planck Collaboration III (2016) 

Near sidelobe 
pickup 

Optical response at angles < 5° 
from the main beam 

Masking of Galaxy and point sources 

Planck Collaboration II (2016), 
2.1.2, 3.2.1 

Far sidelobe pickup 

Main and sub-reflector spillover 

Model sidelobes removed from timelines 

2.1.1, 3.2.1 

Analogue-to-digital 
converter nonlinearity 

Back-end analogue-to-digital 
converter 

Template fitting and removal 

3.2.3 

Imperfect photometric 
calibration 

Sidelobe pickup, radiometer noise 
temperature changes, and other 
non-idealities 

Adaptive smoothing algorithm using 4n 
beam, 4-K reference load voltage output, 
temperature sensor data 

Planck Collaboration II (2016), 
2.2, 3.2.2 

Pointing 

Uncertainties in pointing reconstru¬ 
ction, thermal changes affecting 
focal plane geometry 

Negligible impact on anisotropy 
measurements 

2.1, 3.2.1 


Effects specifically impacting polarization 


Bandpass asymmetries 

Differential orthomode transducer 
and receiver bandpass response 

Spurious polarization removal 

2.3 

Polarization angle 
uncertainty 

Uncertainty in the polarization 
angle in-flight measurement 

Negligible impact 

2.1.3, 3.2.1 

Orthomode transducer 
cro s s -polarization 

Imperfect polarization separation 

Negligible impact 

Leahy et al. (2010) 


level of near sidelobes is about -40 dB at 30 GHz, and -50 dB 
at 70 GHz, with the shape of a typical diffraction pattern. 

Near sidelobes can be a source of systematic effects when 
the main beam scans the sky near the Galactic plane or in the 
proximity of bright sources. In the parts of the sky dominated by 
diffuse emission with little contrast in intensity, these lobes in¬ 
troduce a spurious signal of about 10 -5 times the power entering 
the main beam. 

We expect that the effect of near sidelobes on CMB mea¬ 
surements is small, provided that we properly mask the Galactic 
plane and the bright sources. For this reason we did not remove 
such an effect from the data and assessed its impact by generat¬ 
ing simulated sky maps observed with and without the presence 
of near sidelobes in the beam and then taking the difference. We 
show and discuss such maps in Sect. 3.2.1 and the power spectra 
of this effect in Figs. 24, 25 and 26. 

2.1.3. Polarization angle 

We now discuss the systematic effect caused by the uncertainty 
in the orientation of the feed-horns in the focal plane. From 
thermo-elastic simulations we found this uncertainty to be about 
0.2° (Villa et al. 2005). In this study we adopt a more conserva¬ 


tive approach in which we set the uncertainties using measure¬ 
ments of the Crab Nebula. Then we perform a sensitivity study 
in which we consider a fiducial sky observed with a certain po¬ 
larization angle for each feed-horn and then reconstruct the sky 
with a slightly different polarization angle for each feed horn. 
The differences span the range of uncertainties in the polariza¬ 
tion angle derived from measurements of the Crab Nebula. 

In this section we first recall our definition of polarization 
angle and then we discuss the rationale we used to define the 
“error bars” used in our sensitivity study. 

Definition of polarization angle. Each LFI scanning beam 6 is 
defined in a reference frame specified by the three angles 0 UV , 
0 UV , and (/r uv , reported in table 5 of Planck Collaboration II 
(2016) and shown in Fig. 2. This choice implies that the power 
peak of the co-polar component lies along the main beam point¬ 
ing direction, and a minimum in the cross-polar component ap¬ 
pears in the same direction (Planck Collaboration IV 2016). In 
particular, the major axis of the polarization ellipse is along the 


6 Here we refer to both the beams simulated with GRASP and to those 
reconstructed from Jupiter transits. 
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Fig. 1: Example of a cut of the simulated beam pattern of the 
70 GHz LFI18-S radiometer. The cut passes through the main 
reflector spillover of the Planck telescope. The plot shows, in 
particular, the level and shape of the near sidelobes. 


v-axis for the radiometer side arm (S) and it is aligned with the 
y-axis for the radiometer main arm (M). 



Fig. 2: Definition of polarization angle. Left : the orientation of 
the main beam frame, (XYZ) M b, with respect to the line-of-sight 
(LOS) frame, (XYZ)los, is defined by the three angles 6 UV , 0 MV , 
and if uv . The intermediate frame, (XYZ)dx, is the detector frame, 
defined by the two angles 6 UV and f uv . Right : the angle if po \ is 
defined with respect to Xmb and represents the orientation of the 
polarization ellipse along the beam line-of-sight. It is very close 
to 0 or 90 degrees for the S and M radiometers, respectively. 

The main beam is essentially linearly polarized in directions 
close to the beam pointing. The v-axis of the main beam frame 
can be assumed to be the main beam polarization direction for 
the S radiometers and the y-axis of the main beam frame can 
be assumed to be the main beam polarization direction for the M 
radiometers. 

We define if po \ to be the angle between the main beam po¬ 
larization direction and the v-axis of the main beam frame, and 
define the main beam polarization angle, if, as if = if uy + if po \. 
The angle if po \ is nominally either 0° or 90° for the side and main 
arms, respectively. 


The values of i// po \ can be either determined from measured 
data using the Crab Nebula as a calibrator, or from optical simu¬ 
lations performed coupling the LFI feedhoms to the Planck tele¬ 
scope, considering both the optical and radiometer bandpass re¬ 
sponse. 7 

For the current release our analysis uses values of if po i de¬ 
rived from simulations. Indeed, the optical model is well con¬ 
strained by the main beam reconstruction carried out with seven 
Jupiter transits and provides us with more accurate estimates of 
the polarization angle compared to direct measurements. 

As an independent crosscheck, we also consider our mea¬ 
surements of the Crab nebula as a polarized calibrating source. 
We use a least-squares fit of the time-ordered data measured 
during Crab scans to determine /, Q , and U and, consequently, 
the polarization angle. Then we incorporate the instrument noise 
via the covariance matrix and we obtain the final error bars by 
adding in quadrature the uncertainties due to the bandpass mis¬ 
match correction (Planck Collaboration II 2016). 

While such a check is desirable, we find that the polarization 
angles derived from these data display systematic errors much 
larger than those expected from our noise and bandpass mis¬ 
match correction alone, especially at 30 and 44 GHz (horns from 
LFI24 through LFI28) (see Fig. 3). In particular, we find that the 
values obtained for the various horns in the focal plane display 
differences that are larger than our error estimates. 

The horn with the largest apparent offset in angle, LFI2 5, 
is the solitary 44 GHz horn on one side of the focal plane; in 
the next data release we will examine this discrepancy in more 
detail. 

An important difficulty is the determination of the relative 
gains of the individually polarized receivers, particularly during 
the Crab crossings, which appear near the minima of our princi¬ 
pal temperature calibration. Another souce of uncertainty miss¬ 
ing from the Crab analysis is beam errors. Of course, the LFI 
radiometer polarization angles are not changing over time, but 
the variability in the estimates limits our use of the Crab cross¬ 
ings for this purpose. 
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Fig. 3: Crab Nebula polarization angle measured by the various 
feed-horns in the focal plane. The straight horizontal line reports 
the value from Aumont et al. (2010) converted to Galactic coor¬ 
dinates, and the yellow area is the ±1 cr uncertainty. 


Definition of error bars. The if vo \ angle can differ from its 
nominal value because of small misalignments induced by 

7 The polarization angle is defined as \f vo \ = arctan(F rhc /Fih C )- Here 
F rhc and E ]hc are the right- and left-hand circularly polarized compo¬ 
nents of the field, which can be defined in terms of the co- and cross- 
polar components, E co and E cx , as £ rhc (ihc) = (£ co -(+) E cx )/ V2 (TICRA 
Engineering Consultants 2008). 
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the mechanical tolerances, thermo-mechanical effects during 
cooldown, and by uncertainties in the the optical and radiome¬ 
ter behavior across the band. If we consider the variation of if/ po \ 
across the band in our simulations, for example, we find devia¬ 
tions from the nominal values that are, at most, 0.5°. 

To estimate the impact of imperfect knowledge of the polar¬ 
ization angle on CMB maps, we use the errors derived in the 
Crab analysis, which include the scan strategy and white noise 
and bandpass mismatch correction errors. While the errors de¬ 
rived this way are not designed to capture the time variation of 
the actual Crab measurements, we believe they provide a conser¬ 
vative upper bound to the errors in our knowledge of the instru¬ 
ment polarization angles. 

The two panels in Fig. 4 show the values of if/ po \ derived 
from GRASP simulations (which are also used by the data analy¬ 
sis pipeline) and the error bars obtained from Crab observations. 
Notice that the scatter of the simulated angles is much less than 
the size of the error bars. This is consistent with uncertainty on 
the simulated angles that is much smaller than the error bars de¬ 
rived from Crab measurements. These data are the basis of the 
simulation exercise discussed in Sect. 3.2.1. 



Fig. 4: Simulated polarization angles and error bars from Crab 
measurements used in the analysis. Top : radiometer main arm. 
Bottom : radiometer side arm. The scatter of the plotted angles is 
much less than the error bars because the uncertainty in our sim¬ 
ulations is much smaller than the error bars derived from Crab 
measurements. 

Our on-ground determination of radiometer polarization an¬ 
gles is more than sufficient for the CMB polarization. As seen in 
the measurements of the Crab Nebula, the impact of gain errors 
among our polarized radiometers may be important, and we do 
include this effect in our gain error simulations. 

2.1.4. Pointing 

Pointing reconstruction is performed in two steps. The first is the 
reconstruction of the satellite attitude, the second is the measure¬ 
ment of the orientation of the individual detectors with respect to 
the focal plane boresight (focal plane geometry reconstruction). 
In the first step we take into account all common-mode variations 


between the star camera and focal plane frames and assume the 
focal plane reconstruction, so that the focal plane geometry is 
essentially fixed over the entire mission. 

Planet scans indicate that the satellite attitude, reconstructed 
from the star camera data, contains slow timescale variations 
(^ 1 month) leading to total errors up to about 30". The two 
major modes are a linear drift and a modulation that is heavily 
correlated with the Sun-Earth distance. To correct these fluctu¬ 
ations we fit a linear drift and a solar distance template to the 
planet position offsets, and include discontinuous steps at known 
disturbances of the thermal environment. Further details about 
the pointing reconstruction can be found in section 5.3 of Planck 
Collaboration I (2016). 

In this paper we evaluate the impact on the CMB maps and 
power spectra of residual uncertainties in the pointing recon¬ 
struction process. We perform the assessment using simulations 
in which the same sky is observed with two different pointing 
solutions that represent the uncertainty upper limit. We describe 
the approach and the results obtained in Sect. 3.2.1. 

2.2. Imperfect calibration 

The analysis of the first data release showed that the uncertainty 
in the calibration is one of the main factors driving the system¬ 
atic effects budget for Planck-LFI. The accuracy of the retrieved 
calibration constant depends on the signal-to-noise ratio (S/N) 
between the dipole and instrumental noise along the scan direc¬ 
tions, on effects causing gain variations (e.g., focal plane tem¬ 
perature fluctuations), and on the presence of Galactic stray light 
in the measured signal. 

In the analysis for the 2015 release we have substantially 
revised our calibration pipeline to account for these effects and 
to improve the accuracy of the calibration. The full details are 
provided in Planck Collaboration V (2016), and here we briefly 
list the most important changes: (i) we derive the Solar dipole 
parameters using LFI-only data, so that we no longer rely on 
parameters provided by Hinshaw et al. (2009); (ii) we take into 
account the shape of the beams over the full 4n sphere; (iii) we 
use an improved iterative calibration algorithm to estimate the 
calibration constant K (measured in VK' 1 ); 8 and (iv) we use a 
new smoothing algorithm to reduce the statistical uncertainty in 
the estimates of K and to account for gain changes caused by 
variations in the instrument environment. 

We nevertheless expect residual systematic effects in the cal¬ 
ibration constants due to uncertainties in the following pipeline 
steps. 

1. Solar dipole parameters derived from LFI data. This affects 
only the absolute calibration and impacts the overall dynamic 
range of the maps, as well as the power spectrum level. We 
discuss the absolute calibration accuracy in Planck Collabo¬ 
ration V (2016) and do not address it further here. 

2. Optical model and radiometer bandpass response. This en¬ 
ters the computation of the 4 n beams, which are used to ac¬ 
count for Galactic straylight in the calibration. 

3. A number of effects (e.g., the impact of residual Galactic 
foregrounds) that might bias the estimates of the calibration 
constant K. 

4. The smoothing filter we use to reduce the scatter in the values 
of K near periods of dipole minima might be too aggressive, 
removing features from the set of K measurements that are 

8 We have implemented such improvements into a new module named 
DaCapo, described in section 7.1 of Planck Collaboration II (2016). 
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not due to noise. This could cause systematic errors in the 
temperature and polarization data. 

We estimate the residual calibration uncertainties using sim¬ 
ulations, as discussed in Sect. 3.2.2. For this release we neglect 
effects caused by imperfect knowledge of the far sidelobes. In 
Planck Collaboration V (2016) we provide an overall upper limit 
based on the consistency of power spectra derived from different 
radiometers. 

We are currently evaluating ways to improve this assessment 
in the context of the next Planck release. One possibility would 
be to use Monte Carlo simulations to assess the impact on cali¬ 
bration of uncertainties in the beam far sidelobes. 

2.3. Bandpass mismatch 

Mismatch between the bandpasses of the two orthogonally- 
polarized arms of the LFI radiometers causes leakage of fore¬ 
ground total intensity into the polarization maps. The effect and 
our correction for it are described in section 11 of Planck Col¬ 
laboration II (2016) and references therein. A point to note is 
that the correction is only applied to at an angular resolution of 
1°, although appendix C of Planck Collaboration XXVI (2016) 
describes a special procedure for correcting point source pho¬ 
tometry derived from the full resolution maps. 

Residual discrepancies between the blind and model-driven 
estimates of the leakage are noted in Planck Collaboration II 
(2016), which imply that the small (typically < 1 %) mismatch 
corrections are not perfect. The estimated fractional uncertainty 
in these corrections is < 25 % at 70 GHz and < 3 % at 30 GHz; 
the discrepancies are significant only because they are driven by 
the intense foreground emission on the Galactic plane. 

As detailed in Sect. 3.1, our cosmological analysis of polar¬ 
ization data is restricted to 46 % of the sky with the weakest fore¬ 
ground emission. Planck Collaboration XI (2016) demonstrates 
that in this region the bandpass correction has a negligible ef¬ 
fect on the angular power spectrum and cosmological parame¬ 
ters derived from it, the optical depth to reionization, r, and the 
power spectrum amplitude. The same applies to our upper limit 
on the tensor-to-scalar ratio, Consequently the impact of the un¬ 
certainty in the correction is also negligible for the cosmological 
results. 


3. Assessing residual systematic effect 
uncertainties in maps and power spectra 

In this section we describe our assessment of systematic effects 
in the LFI data, which is based on a two-steps approach. 

The first is to simulate maps of each effect (see Table 2) and 
combine them into a global map that contains the sum of all the 
effects. We perform simulations for various time intervals, single 
surveys, individual years and full mission, and we use such sim¬ 
ulations to produce a set of difference maps. For example, we 
construct global systematic effects year-difference maps as the 
sum of all systematic effects for one year subtracted from from 
the sum of all systematics from another year. We also compare 
the pseudo-spectra computed on the full-mission maps with the 
expected sky signal to assess the impact of the various effects. 
This step is described in Sect. 3.2. 

The second is to calculate the same difference maps from 
flight data. We call these maps null maps , because they should 
contain only white noise, as the sky observed in the time inter¬ 
vals of each pair of maps is the same. Here we compare the null 


Table 2: List of the simulated systematic effects. 


Optical effects . . 

Near sidelobes 
Pointing uncertainty 
Polarization angle uncertainty 

Thermal effects . 

4 K stage temp, fluct. 
20 K stage temp, fluct. 
300 K stage temp, fluct. 

Calib. dependent 

ADC non-linearity 
Calibration uncertainty 

Electronics .... 

1-Hz spikes 
Bias fluctuations 


maps pseudo-spectra with the pseudo-spectra of the global sys¬ 
tematic effects difference maps. Our objective, in this case, is 
to highlight any residuals in the pseudo-spectra obtained from 
flight data that are not accounted for by our simulations. This 
step is described in Sect. 3.3. 

In all cases we compute pseudo-spectra using the HEALPix 
anafast code and correct for the fraction of observed sky. In 
other words, in all the power spectra of this work we have Q = 
Q, anafast//sky, where Q ?a nafast is the power spectrum as obtained 
by the anafast code and / s ky is the fraction of observed sky. 

In Sect. 3.1 we start by reviewing the masks applied in the 
calculation of the pseudo-spectra used in our assessment. 

3.1. Masks 

We have used three masks to compute the power spectra dis¬ 
cussed in this paper , and we show them in the three panels of 
Fig. 5. 

The first mask (top panel of Fig. 5) is used for total intensity 
maps of the systematic effects. It removes the Galactic plane and 
point sources. It is the “UT78” mask described in section 4.1 
of Planck Collaboration IX (2016), obtained by combining the 
Commander, SEVEM, and SMICA confidence masks. 

The second mask (middle panel of Fig. 5) is used for Q and U 
maps of the systematic effects. It removes about 54 % of the sky, 
cutting out a large portion of the Galactic plane and the Northern 
and Southern Spurs. We adopted this mask in the low-7 1 likeli¬ 
hood used to extract the reionization optical depth parameter, r 
(see figure 3 in Planck Collaboration XI 2016). We chose to use 
the same mask in the assessment of systematic effect uncertain¬ 
ties in polarization. 

The third mask (bottom panel of Fig. 5) is used in the null 
maps analysis at all frequencies both in temperature and polar¬ 
ization. We obtained this mask by combining the UPB77 30- 
GHz polarization mask (right panel of figure 1 in Planck Collab¬ 
oration IX 2016) and the 30-GHz point source mask used for the 
2013 release described in section 4 of Planck Collaboration XII 
(2014) 9 . 


9 Because difference maps may contain unobserved pixels, in each null 
test we take the union between this mask and any set of unobserved 
pixels. For example, maps of single surveys do not cover the full sky, 
which requires us to combine the mask with the unobserved pixels in 
the null map. 
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Fig. 5: Masks used in this work. Top: mask used in the compu¬ 
tation of power spectra of simulated systematic effect total in¬ 
tensity maps. Middle: mask used in the computation of power 
spectra of Q and U systematic effect maps. Bottom: mask used 
in the computation of power spectra of null maps. 


3.2. Assessing systematic effects via simulations 
(“bottom-up”) 

3.2.1. Optics and pointing 

Far and near sidelobes. To assess the effect of far and near 
sidelobes we simulate the residual signal by observing a fiducial 
sky with a beam pattern containing only the beam component 
being tested. The sky signal contains the CMB and foregrounds 
as observed by each radiometer, including the spurious polariza¬ 
tion caused by the bandpass mismatch. Further details regarding 
the the fiducial sky can be found in Planck Collaboration XII 
(2016), a description of the simulation pipeline is in Reinecke 
et al. (2006), and the Madam mapmaker is described in Kurki- 
Suonio et al. (2009); Keihanen et al. (2010). 

We perform this assessment by projecting timelines of the 
sky convolved with the beam pattern into maps. First we use the 
spherical harmonic components of the beam (Planck Collabora¬ 


tion IV 2016) to generate timelines. 10 Then we produce maps 
using the Madam mapmaker with the same parameters used for 
the sky maps (Planck Collaboration VI 2016). 

We simulate far sidelobes with the GRASP Mr-GTD * 11 anal¬ 
ysis, considering all the first-order contributions and two con¬ 
tributions at second order (reflections and diffractions from the 
sub-reflector, which are diffracted by the main reflector). This 
choice allows us to keep the computational time within the avail¬ 
able CPU resources at the cost of a small fraction of power that 
is not accounted for in the sidelobe region of the beam pattern. 

The power lost because of our approximation is ^ 0.5 % (see 
table 1 in Planck Collaboration IV 2016). To estimate the level 
of uncertainty introduced by this lost power, we rescale the far- 
sidelobe spherical harmonic coefficients so that the total beam 
efficiency is equal to 100 %. Then we simulate maps of the effect 
from native and rescaled sidelobes and compare the two corre¬ 
sponding power spectra. 

Figure 6 shows the impact of this approximation. The 
coloured area is the region in /’-space between the two power 
spectra and represents the uncertainty due to the first-order ap¬ 
proximation in the GRASP analysis. For the purpose of comparing 
the power spectrum of systematic effects with the sky signal, this 
uncertainty is small and we have neglected it. 

Figure 7 shows full-sky maps of the Galactic stray light de¬ 
tected by the far-sidelobe beam patterns. This signal is removed 
from the timelines, so we do not consider it in the budget of sys¬ 
tematic uncertainties. Moreover, in Figs. 24, 25, and 26 we plot 
the power spectrum of this effect and show that even if we did 
not remove it from the data, the effect would be at a level much 
lower than the sky signal. 

Our results show that the effect from Galactic straylight is 
significantly larger at 30 GHz compared to 44 and 70 GHz, for 
which the level of the spurious signal is similar. 

To understand this result one must consider that this effect 
depends on two factors: (i) the level of the beam far sidelobes 
and (ii) the intensity of the Galactic signal. The level of the beam 
far sidelobes results from the coupling of the feed-horns beam 
pattern with the secondary mirror. 

A larger feed-horn main beam illuminates more effectively 
the secondary mirror. This determines a narrower main beam of 
the entire optical system and a higher level of far sidelobes. In 
Planck -LFI the 44 GHz feed-horns have narrower beams com¬ 
pared to the 30 and 70 GHz horns and, for this reason, the power 
in the far sidelobes is significantly smaller. 

If we also consider that the Galactic signal intensity de¬ 
creases with frequency we understand our result, which is com¬ 
pletely consistent with pre-launch optical simulations. The inter¬ 
ested reader can find more details in Sandri et al. (2004), Burig- 
ana et al. (2004) and Sandri et al. (2010). 

Ideally our analysis would assess the impact of the accuracy 
in our far-sidelobe model on the systematic effects analysis. The 
proper way to do this would be to identify the sources of uncer¬ 
tainty in the model and run Monte Carlo simulations, producing 
several far sidelobes with GRASP and propagating the analysis to 
sky maps and power spectra. 

Such an analysis would require a considerable amount of 
computing time and we did not perform it for this release, but 
instead rely on null-test analyses. Null maps from consecutive 

10 In this step we use the conviqt_v4 and multimod routines (Rei¬ 
necke et al. 2006) with parameters reported in table 6 of Planck Collab¬ 
oration IV (2016). 

11 Multi reflector geometrical theory of diffraction (TICRA Engineer¬ 
ing Consultants 2012). 
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Fig. 6: Uncertainty in the power spectra of the effect from far 
sidelobes introduced by the first-order approximation in GRASP 
simulations. Top: TT spectrum. Middle: EE spectrum. Bottom: 
BB spectrum. For each frequency the coloured area is the region 
between the native power spectrum and the one rescaled to ac¬ 
count for the missing power. 


surveys are quite sensitive to the pickup of straylight by the far 
sidelobes and can be used to assess the presence of straylight 
residuals in the data. We discussed this point in Sect. 3.3. 

We study the effect coming from the near sidelobes following 
the same procedure used for the far sidelobes. The main differ¬ 
ence is that, in this case, we do not apply any correction to the 
data, so that our simulations estimate the systematic effect that 
we expect to be present in the data. 

The maps in Fig. 8 show that near sidelobes especially im¬ 
pact measurements close to the Galactic plane. This is expected, 
because this region of the beam pattern is close to the main beam 
and causes a spurious signal when the beam scans regions of the 
sky with large brightness variations over small angular scales. 
This implies that near sidelobes do not significantly impact the 
recovery of the CMB power spectrum if the Galactic plane is 
properly masked. We confirm this through the power spectra, as 
shown in Figs. 24, 25, and 26. 

Polarization angle. We study how the uncertainty in the polar¬ 
ization angle affects the recovered power spectra by means of 
a limited Monte Carlo exercise. We first produce a fiducial sky 
containing the CMB and foregrounds observed with the nomi¬ 
nal polarization angles (Fig. 4) and then we generate five addi¬ 
tional skies observed with a slightly different polarization angle 
for each feedhorn. Finally we compute the difference between 
each of the five maps and the fiducial sky. 

In each of the five cases we rotate the polarization angle of 
each feed-horn by an amount equal to either the maximum or the 
minimum of the error bars shown in Fig. 4. In this way we can 
explore, for a small number of cases, a range of variability in the 
polarization angle that is larger compared to the range expected 
from the focal plane thermo-mechanical analysis. 

The difference maps in Fig. 9 show that the effect is negligi¬ 
ble in temperature (as expected) and is less than 1 yuK at 70 GHz 
in polarization. At 30 and 44 GHz the maximum amplitude of the 
effect is around 2 yuK and 1 yuK, respectively. The maps shown 
represent one of the five cases picked randomly from the set. 

In Figs. 10 and 11 we show the dispersion of the peak-to- 
peak and rms of this effect on maps, once we apply the masks 
in Fig. 5 (top one for total intensity and middle one for Q and 
U maps). The rms of the effect is smaller than 1 yt/K and also the 
dispersion introduced by the five different cases is small. 

We observe that the peak-to-peak and rms of the effect in the 
polarization map decrease with frequency (see the bottom panels 
of Figs. 10 and 11). This correlates with the smaller contribution 
of polarized synchrotron emission in maps at higher frequency. 

We also observe a higher residual at 44 GHz in temperature 
maps compared to the 30 and 70 GHz channels. We did not ex¬ 
pect this behavior, and it is currently not understood. The effect 
in temperature, however, is much less than 0.1 pK and, therefore, 
completely negligible. 

From the five sets of difference maps we have computed 
power spectra and evaluated their dispersion. We show the re¬ 
sults in Fig. 12, where the grey area represents the region con¬ 
taining all the spectra and the blue curve is the average of these 
five spectra. The blue curve corresponds to the spectrum that is 
also reported in Figs. 24, 25, and 26. 

Pointing. We have simulated the effect caused by pointing un¬ 
certainty by adding a Gaussian noise realization independently 
to both co-scan and cross-scan bore sight pointing. The noise re¬ 
alization was drawn from a 1 // noise model with a smooth cutoff 
at 10 mHz, which matches the single-planet transit analysis and 
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Fig. 7: Maps of the effect from far sidelobes. Rows correspond to 30, 44, and 70 GHz channels, while columns correspond to /, Q , 
and U. The stray light signal at 30 GHz is larger compared to 44 and 70 GHz. The 44 GHz channel is the least contaminated by this 
effect. This behavior results from the combination of the beam far sidelobes and the intensity of the Galactic emissions at the LFI 
frequencies. 


multiple transit results over the entire mission. The rms net ef¬ 
fect of the added pointing errors is an uncertainty of about 4.8" 
at timescales shorter than 10 000 s, and about 5.1" at timescales 
longer than 10000s. The overall uncertainty is approximately 
7.0". 

Figure 13 shows full-sky maps of the estimated systematic 
effect caused by pointing uncertainty. 

The level of the spurious residual is very small. In polariza¬ 
tion it is much less than 1 yuK at all frequencies, whereas in total 
intensity it is larger, of the order of a few yuK, being dominated 
by point sources along the Galactic plane. The 30 GHz chan¬ 
nel is the most affected by this effect; this is expected, because 
at 30 GHz the emission from point sources is stronger than at 
higher frequencies, and the reconstruction of their positions on 
the sky is particularly sensitive to pointing accuracy. 

3.2.2. Imperfect calibration 

We assess the effect of uncertainties in the relative photomet¬ 
ric calibration of each radiometer by differencing a model sky 
map and a second map obtained by applying the same calibra¬ 
tion pipeline used in the data analysis. 

We start by generating timelines from the measured sky 
maps at 30, 44, and 70 GHz. We use these maps as our model 
sky, already convolved with the telescope beam pattern and ra¬ 
diometric bandpass response. These maps contain the CMB, the 


diffuse foreground emission, and a small residual of the instru¬ 
ment noise and systematic effects. We are interested in how well 
the calibration pipeline is able to reproduce this model sky, so 
that these residuals do not represent a limitation in our analysis. 

Then we add the following three components: (i) the dipole 
signal convolved with the model sidelobes (see section 7.1 of 
Planck Collaboration II 2016); (ii) the Galactic stray light esti¬ 
mated according to the procedure described in section 7.4 of 
Planck Collaboration II (2016); and (iii) the radiometer noise 
(white + 1 //) generated starting from the radiometer parameters 
in the instrument database. We report and discuss these parame¬ 
ters in table 10 of Planck Collaboration II (2016). 

The final step in data preparation is to convert the timelines 
into voltage units. We do this by multiplying each sample by the 
corresponding gain constant used in the data analysis. We have 
chosen this approach to have a variability that closely represents 
the actual measurements. We have also repeated this exercise 
with different choices of the fiducial gain solution and we have 
verified that the result does not depend on them at first order. 

At this point we apply the calibration pipeline to these time¬ 
lines to recover the gain constants. These constants will not be 
identical to the input ones, because of the noise present in the 
data. The combination of the dipole and Galactic straylight vari¬ 
ability with the instrument noise causes a difference between the 
input and recovered constants that varies with time. 
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Fig. 8: Maps of the effect from near sidelobes. Rows correspond to 30, 44, and 70 GHz channels, while columns correspond to /, Q , 
and U. 


We evaluate the impact of the difference between the input 
and recovered gain constants by differencing the input maps with 
those generate using the recovered gains. We show these maps 
in Fig. 14. These maps show that the effect is of the order of 
2yuK peak-to-peak at 44 and 70 GHz, and 6/rK peak-to-peak at 
30 GHz. 

This is the effect with the largest impact on LFI polarization 
data and drives the systematic effect uncertainties. At 30 GHz 
the residual is about five orders of magnitudes less than the syn¬ 
chrotron emission in temperature and about ten times less in po¬ 
larization. We expect, therefore, that we can use this channel as 
a foreground template with negligible impact from systematic 
uncertainties. We have verified this in the analysis presented in 
Sect. 3.4, where we assess the impact of systematic effects in 
the 30 and 70 GHz channels on the reionization optical depth 
parameter, r. 

At 70 GHz the residual is less than the CMB £-mode power 
spectrum, apart from the range of multipoles 10-20. We evalu¬ 
ated the impact of these uncertainties on the reionization optical 
depth, r, and found them to be small. We discuss this assessment 
in Sect. 3.4. At 44 GHz the residual effect is at the level of the E- 
mode power spectrum for f < 10 and exceeds it in the multipoles 
range 10-30. In this release we did not use the 44 GHz data in 
the extraction of r. We are currently evaluating strategies to im¬ 
prove the photometric calibration accuracy and we will report 
the results of this effort in the context of the next release. 


3.2.3. ADC non linearity 

We assess the effect of the ADC nonlinearity by taking differ¬ 
ences between simulated maps containing the ADC effect and 
fiducial, clean maps. This is the same approach described in 
Planck Collaboration III (2014) and is based on the following 
steps. 

First we produce time-ordered data with and without a 
known ADC error for each detector. To do this we start from 
full-mission sky maps and rescan them into time-ordered data 
using the pointing information. We de-calibrate the data using a 
gain model based on the actual average of the calibration con¬ 
stant and time variations obtained from relative fluctuations of 
the reference voltage (the “4-K calibration” method described in 
section 3 of Planck Collaboration V 2014). Then we add voltage 
offsets, drifts, and noise, in agreement with those observed in in 
the real, raw data. 

We add the ADC effect to the time-ordered data of each 
detector applying the inverse spline curve used to correct the 
data. For the channels where we do not apply any correction 
we add a conservative estimate of the effect using the estimator 
£adc = (l/<V sky ))(dy WN , S k y /^V W N,ref), where <V sky ) is the aver¬ 
age sky voltage and dVwN,sky, £FwN,ref are the estimates of the 
white noise in the sky and reference load voltages, respectively. 
We discuss the rationale behind this choice in appendix B of 
Planck Collaboration III (2014). 

We then determine ADC correction curves from these simu¬ 
lated time-ordered data and remove the estimated effect. A resid- 
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Fig. 9: Maps of the effect from uncertainty in the polarization angle. The maps shown are randomly selected from one of the five 
tested realizations. Rows correspond to 30, 44, and 70 GHz channels, while columns correspond to /, Q , and U. 
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Fig. 10: Peak-to-peak of the effect from polarization angle un¬ 
certainty on LFI maps. The error bars represent the dispersion of 
the five cases chosen in the analysis. Top : total intensity. Bottom. 
Q and U Stokes parameters. 


Fig. 11: Rms of the effect from polarization angle uncertainty 
on LFI maps. The error bars represent the dispersion of the five 
cases chosen in the analysis. Top: total intensity. Bottom : Q and 
U Stokes parameters. 
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Fig. 12: Angular power spectra of the residual effect due to polarization angle uncertainty compared to the foreground spectra at 
30 GHz and to Planck beam-filtered temperature and polarization spectra at 44 and 70 GHz. The blue curve represents the average 
spectrum, while the grey band is the envelope of all the power spectra calculated from the various realizations of the effect. The 
theoretical 5-mode CMB spectrum assumes a tensor-to-scalar ratio r = 0.1, a tensor spectral index m = 0 and has not been 
beam-filtered. Rows are for 30, 44, and 70 GHz spectra, while columns are for 7T, EE and BB power spectra. 
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Fig. 13: Maps of the effect from pointing errors. Rows correspond to 30, 44, and 70 GHz channels, while columns correspond to /, 
Q , and U. 


ual remains, though, since the reconstruction is not perfect be¬ 
cause of the presence of noise in the data. The effect of this 
residual is what we estimate in our simulations. 

Finally we produce difference maps from time-ordered data 
with and without the residual ADC effect (Fig. 15). 

In our previous results (Planck Collaboration III 2014) the 
rms fluctuations away from the Galactic plane were about 1 and 
0.3 yt/K at 30 and 44 GHz. Now they are 0.3 and 0.1 n K, respec¬ 
tively. In these two frequency channels Q and U maps show 
ADC stripes at the level of 0.07 and 0.05 ji K, respectively. In 
the Galactic plane we see features in both intensity and polariza¬ 
tion at the level of a few yuK at 30 GHz and a fraction of a //K at 
44 GHz. 

The case at 70 GHz is more complicated, because the white 
noise is higher and also because the data from some of the diodes 
were not corrected. This leads to the appearance of a broad stripe 
with an amplitude of about 0.3 yuK. 

3.2.4. Thermal effects 

Temperature fluctuations of the 4-K reference loads, of the 20- 
K focal plane, and of the 300-K receiver back-end modules are 
a source of systematic variations in the measured signal. Fluc¬ 
tuations in the temperature of the 4-K reference loads couple 
directly with the differential measurements, while fluctuations 
in the 20-K and 300-K stages couple with the detected sig¬ 
nal through thermal and radiometric transfer functions. Thermal 
transfer functions are described in section 3 of Tomasi et al. 


( 2010 ), while a complete description of the radiometric cou¬ 
pling with temperature fluctuations can be found in Terenzi et al. 
(2009). We also provide a general treatment of the susceptibility 
of the LFI receivers to systematic effects in section 3 of Seiffert 
et al. ( 2002 ) (see, especially, equation 10 ). 

The three panels in Fig. 16 show the behavior of the relevant 
LFI temperature over the entire mission, with labels identifying 
relevant events that occurred during the mission. The grey bands 
identify the eight surveys. 

The top panel shows the temperature of the 4-K loads at 
the level of the 30 and 44 GHz (bottom curve) and 70 GHz (top 
curve) channels. The rms variation of this temperature over the 
whole mission is 0 - 30,44 = 1.55 mK and <x 70 = 80yuK. 

The middle panel displays the 20-K focal plane tempera¬ 
ture measured by a sensor mounted on the flange of the 30 GHz 
LFI28 receiver feedhorn. There are some notable features. The 
most stable period is the one corresponding to the first survey. 
After the sorption cooler switchover we see a period of temper¬ 
ature instability that spanned about half of the third survey and 
that was later controlled by commanded temperature steps that 
we continued to apply until the end of the mission. The bottom 
panel shows the behavior of one of the the back-end temperature 
sensors. We notice a short period temperature fluctuation during 
the first survey, which was caused by the daily on-off switching 
of the transponder. This was later left on to reduce these 24- 
hour variations (see the temperature increase after day 200). We 
also see a temperature drop corresponding to the sorption cooler 
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Fig. 14: Maps of the effect from imperfect relative calibration. Rows correspond to 30, 44, and 70 GHz channels, while columns 
correspond to /, Q , and U. Maps are smoothed to the beam optical resolution of each channel (#fwhm = 33', 28', and 13', respec¬ 
tively). 


switchover and a seasonal periodic variation correlated with the 
yearly orbit around the Sun. 

We assess the effect of temperature variations following the 
procedure described in section 4.2.1 of Planck Collaboration III 
(2014). We combine temperature measurements with thermal 
and radiometric transfer functions to obtain time-ordered data of 
the systematic effects. We then use these time-ordered data and 
pointing information to produce maps. For this release we used 
the same thermal and radiometric transfer functions that were 
applied in the analysis of the 2013 release. 

In Fig. 17 we show maps in total intensity and polarization of 
the combined thermal effects. In each of these maps the impact 
of thermal fluctuations is less than 1 yt/K, which is negligible. 

3.2.5. Bias fluctuations 

We assess the effect of bias fluctuations in the LFI front-end 
modules on temperature and polarization measurements, disen¬ 
tangling the various sources of electrical instabilities. They are: 

- thermal fluctuations in the analog electronics; 

- thermal fluctuations in the instrument front-end; 

- electrical instabilities in analogue electronics; and 

- electrical instabilities affecting the cold amplifiers that may 
be generated either inside or outside the device (e.g., electric 
line instabilities or cosmic rays). 


We follow a procedure in which we correlate the radiomet¬ 
ric signal with measured drain currents. For each radiometer we 
first remove fluctuations caused by thermal instabilities in the 
cold and warm units (equation 1 in Planck Collaboration III 
2014), and then we correlate the residual drain current fluctu¬ 
ations with the voltage output of both radiometer diodes (equa¬ 
tion 2 in Planck Collaboration III 2014). 

We obtain four coefficients: two of them (o^o k and (* 300 k) 
are the correlation coefficients between the measured currents 
and temperatures, the other two (cr sky and a re f) link the total 
power sky and reference-load voltage outputs with drain current 
measurements corrected for thermal effects. 

In this release we updated cr S k y and a re f, exploiting the possi¬ 
bility of measuring drain currents every 6 s instead of every 64 s 
(the default time interval for this housekeeping parameter). To 
enable this faster acquisition we developed a dedicated teleme¬ 
try procedure that was not available for the 2013 release. 

The thermal coefficients, instead, are the same as those used 
in the 2013 release. We measured them by exploiting con¬ 
trolled temperature variations during the in-flight calibration 
phase (Gregorio et al. 2013) and temperature fluctuations in¬ 
duced by the transponder being switched on and off every day 
during the first survey (see figure 26 in Planck Collaboration II 
2011). Since we did not perform other tests involving temper¬ 
ature changes during the mission we did not update a 20 k and 
t* 300 K between the 2013 and 2015 data release. 
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Fig. 15: Maps of the ADC nonlinearity effect. Rows correspond to 30, 44, and 70 GHz channels, while columns correspond to /, Q , 
and U. Maps are smoothed to the beam optical resolution of each channel (#fwhm = 33', 28', and 13', respectively). 


With these coefficients we use the drain current measure¬ 
ments to generate time-ordered-data that we project onto the sky. 

Fig. 18 shows maps in temperature and polarization of the 
systematic effect from bias fluctuations. This effect is less than 
1 //K both in temperature and polarization, which is negligible 
compared to the CMB at 44 and 70 GHz and foregrounds at 
30 GHz. These results are also consistent with the 2013 analy¬ 
sis in temperature (Planck Collaboration III 2014). 

3.2.6. 1-Hz spikes 

This effect is caused by a well-known cross-talk between the 
housekeeping 1-Hz acquisition clock and the scientific data ac¬ 
quisition. We have described this effect in several previous pa¬ 
pers. In section 5.2.5 of Mennella et al. (2010) we discuss how 
we characterized it during ground tests, in section 4.1.2 of Gre¬ 
gorio et al. (2013) we presented a similar characterization per¬ 
formed during flight calibration, in section 3.1 of Zacchei et al. 
(2011) we explained how we build templates of this effect and 
remove them from the data, and in section 4.2.3 of Planck Col¬ 
laboration III (2014) we show how we assess the impact of resid¬ 
ual uncertainties on the LFI temperature results. 

Here we extend our analysis to temperature and polarization 
data using the full mission data set, using the same procedure 
explained in Planck Collaboration III (2014). 

The maps in Fig. 19 show that this effect is less than 1 yuK 
at 30 and 70 GHz and about 1-2yuK at 44 GHz. This channel, 


indeed, is the most affected by 1-Hz spikes and it is the only 
one that we correct by removing the signal template from the 
time-ordered data. The 30 and 70 GHz data, instead, are only 
slightly affected by this spurious signal and we do not apply any 
correction. 


3.3. Assessing systematic effects via null tests ("top-down”) 

We define “null test” as an analysis based on differences be¬ 
tween subsets of data (maps, timelines, power spectra, etc.) that, 
in principle, contain the same sky signal. The Planck scanning 
strategy (see section 4.1 of Planck Collaboration 12016) together 
with the symmetric configuration of the focal plane (see fig¬ 
ure 11 of Bersanelli et al. 2010 and figure 4 of Lamarre et al. 
2010 ) offer several useful null-test combinations, each with a 
different sensitivity to various kinds of systematic effects both in 
temperature and in polarization. 

We have routinely carried out null tests during the LFI data 
analysis. These tests played a key role in our understanding of 
the LFI systematic error budget, and led to improvements in the 
self-consistency of our data. These improvements have allowed 
us to use the LFI polarization results at the largest angular scales. 

In this section we discuss the results of our null test analysis. 
First we discuss the general strategy and then we present the 
results obtained showing the robustness of the LFI data against 
several classes of systematic effects. 
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Fig. 16: Top : temperature measured by two sensors mounted on the HFI4-K shield at the level of 30 and 44 GHz (bottom curve) and 
70 GHz (top curve) reference loads. The rms variation of this temperature over the full mission is 0 - 30,44 = 1.55 mK and 0-70 = 80 pK. 
Middle : temperature of the 20-K focal plane measured by a temperature sensor placed on the flange of the LFI28 30 GHz feedhorn. 
The consecutive temperature steps after day 500 reflect changes to the set-point of the temperature control system. We applied these 
changes to control the level of temperature fluctuations. Bottom, temperature of the 300-K back-end unit. 


3.3.1. Null tests strategy 

We complement every Planck -LFI data release with a suite of 
null tests combining data selected at various timescales. 

The shortest timescale is that of a single pointing period 
(~40 minutes) that is split into two parts. We then difference 
the corresponding maps and obtain the so-called half-ring differ¬ 
ence maps that approximate the instrument noise and may con¬ 
tain systematic effects correlated on timescales < 20 minutes. 

Then we have longer timescales: six months (a sky survey), 
one year, the full mission (four years). We can create a large 
number of tests by combining these timescales for single ra¬ 
diometers 12 . We provide the detailed timing of each survey in 
the Planck Explanatory Supplement 13 . 

When we take a difference between two maps we apply a 
weighting to guarantee that we obtain the same level of white 
noise independently of the timescale considered. The weighting 


12 We do not expect that single radiometer survey differences are strictly 
null. Indeed, the radiometers are polarized detectors that observe the 
sky with a different range of polarization angles for different surveys. 
We use these tests to validate the radiometer stability, minimizing these 
effects by considering survey combinations with the same scanning pat¬ 
terns (survey 1 vs survey 3, survey 2 vs survey 4) or by combining 
radiometers to solve for /, Q and U. 

13 http://wiki.cosmos.esa.int/planckpla/index.php/ 
Survey_scanning_and_performance 


scheme is described by equations (30), (31), and (32) of Planck 
Collaboration II (2011), where we normalize the white noise to 
the full mission (8 surveys) noise. This means that in equation 
(32) of Planck Collaboration II (2011) the term hitf u n(p) corre¬ 
sponds to the number of hits at each pixel, p , in the full map. 

We assess the quality of the null tests by comparing null 
maps pseudo spectra obtained from flight data with those coming 
from systematic effect simulations and with noise-only Monte 
Carlo realizations based on the Planck full focal plane (FFP 8 ) 
simulation (Planck Collaboration XII 2016). For the systematic 
effect simulations we used global maps by combining the effects 
listed in Table 2. Monte Carlo realizations include pointing, flag¬ 
ging, and a radiometer specific noise model based on the mea¬ 
sured noise power spectrum. We create 1000 random realizations 
of such noise maps using the same destriping algorithm used for 
the real data, and compute null maps and pseudo-spectra in the 
same way. For each multipole, f, we calculate the mean Q and 
its dispersion by fitting the 1000 Q s with an asymmetric Gaus¬ 
sian. 

Passing these null tests is a strong indication of self- 
consistency. Of course, some effects could be present, at a certain 
level, in the various timescales, so that they are canceled out in 
the difference and remain undetected. However, the combined 
set of map differences allows us to gain confidence of our data 
and noise model. 
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Fig. 17: Maps of thermal systematic effects. Rows correspond to 30, 44, and 70 GHz channels, while columns correspond to /, Q , 
and U. Maps are smoothed to the beam optical resolution of each channel (#fwhm = 33', 28', and 13', respectively). 


In the following part of this section we present the results of 
some null test analyses, that highlight the data consistency with 
respect to various classes of systematic effects. All the power 
spectra are pseudo-spectra computed on maps masked with the 
bottom mask shown in Fig. 5. 

Our results show the level of consistency of the LFI data. At 
70 GHz, in particular, the data pass all our tests both in tempera¬ 
ture and polarization. Small residuals exist at lower frequencies, 
especially at 30 GHz. At this frequency we see the evidence of 
residuals probably due to a non perfect Galactic straylight re¬ 
moval from our data (see results in Sect. 3.3.4). 

None of the detected excess cases appear to be crucial for 
science analysis. Residuals in temperature (which are expected 
to be larger due to the much stronger sky signals) are still or¬ 
ders of magnitude below the power of the signal from the sky 
(see left-hand panels of Figs. 24-26). We use the 30 GHz chan¬ 
nel in polarization (middle and right-hand panels of Fig. 24) as 
a synchrotron monitor for the Planck CMB channels, and the 
observed deviations are small for foreground analysis or compo¬ 
nent separation. 

3.3.2. Highlighting residuals in subsets of data with “full - 
year” difference maps 

We check the consistency of data acquired during each year us¬ 
ing the full-mission map of the corresponding frequency as a ref¬ 
erence to identify particular years that appear anomalous com¬ 


pared to others. For example, we test for spurious residuals in 
the first year of data of the 70 GHz channel by taking the differ¬ 
ence between the year-1 and full-mission maps at 70 GHz. 

The full-mission maps may contain some residual system¬ 
atic effects, but this is not a problem in the context of this test, 
which aims at highlighting relative differences among the vari¬ 
ous year-long datasets. Furthermore systematic effects average 
out more efficiently in full-mission maps than in single-year or 
single-survey maps. We verified this by calculating the peak-to- 
peak variations in simulated maps containing the sum of all sys¬ 
tematic effects. Then we took the ratio between this peak-to-peak 
value calculated for year-maps and that for full-mission maps, 
and obtained values that from 1.2 at 30 GHz to 2.1 at 70 GHz. 

In Fig. 20 we show the results of pseudo-spectra from full - 
year difference maps obtained from data and simulations com¬ 
pared to the range of spectra obtained from the 1000 noise-only 
Monte Carlo simulations. This range is indicated by the colored 
area, which represents the rms spread of the simulated spectra. 

Our analysis shows that at 44 and 70 GHz the null power 
spectra are well explained by noise, while at 30 GHz there are 
some residuals slightly exceeding the lcr region of the Monte 
Carlo simulations. The null spectra from simulated systematic 
effects are below the noise level apart from the first multipoles 
where the simulations in some cases reach the noise level. 
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Fig. 18: Maps of the effect from front-end bias fluctuations. Rows correspond to 30, 44, and 70 GHz channels, while columns cor¬ 
respond to /, Q , and U. Maps are smoothed to the beam optical resolution of each channel (#fwhm = 33', 28', and 13', respectively). 


3.3.3. Checking for time varying effects with “odd - even” 
year difference maps 

We check for time varying effects considering a small change 
that was implemented in the Planck scanning strategy after the 
first two years. At the beginning of the third year the preces¬ 
sion phase angle of Planck spin axis was shifted by 90° (see 
section 4.2 of Planck Collaboration I 2014). 

This shift produced a slight symmetry-break between the 
scanning strategy of the first two and second two years of LFI 
observations. As a consequence, an exact repetition of the same 
configuration of the beams and sidelobes relative to the sky only 
occurs for the survey pairs S \ and S 3 , S 2 and S 4 , S 5 and S 7 , 
S 6 and S'g. Thus differences between these survey pairs con¬ 
tain only time-variable effects (neglecting pointing errors and 
secular changes in the optics, which are known to be small), 
while any beam asymmetry will cancel out exactly. Similarly, 
bandpass effects in a null test involving a given radiometer of a 
given quadruplet are removed. Since these difference maps con¬ 
tain only stochastic residuals, the combination at each frequency: 

(S 1 -S 3 ) + (s 2 -s 4 ) + (s 5 -s 7 ) + (S 6 -S 8 ) = f 1+3 - y 2+4 , (1) 

gives a high signal-to-noise monitor of residuals dominated by 
time-variable effects, such as relative calibration, ADC non¬ 
linearity, thermal effects. 

In Fig. 21 we show the result of null tests for such year com¬ 
bination for all LFI frequency bands, both in temperature and 


polarization. Again we compare the results with Monte Carlo 
noise simulations, as well as with the level of contamination pre¬ 
dicted by our systematic effect simulations. In all cases we find 
very good consistency between data from the null maps and the 
noise. We also find that the systematic effects run well below 
both . 


3.3.4. Highlighting straylight residuals with consecutive 
survey difference maps 

We looked for residual effects in null maps constructed from dif¬ 
ferences between consecutive surveys, which we expect to be 
dominated by Galactic straylight. Indeed, when the spacecraft 
changes from an odd to an even survey it re-visits the same sky 
patch with its orientation reversed by about 180°. As a conse¬ 
quence, the coupling of the beams with the sky is reversed, so 
that differences between odd and even surveys highlight the ef¬ 
fect of main beam asymmetries and straylight from sidelobes. 
This implies that consecutive survey differences are among the 
most demanding null tests. 

In Fig. 22 we display the angular power spectra of a wide 
sample of consecutive survey difference maps and compare them 
with noise and systematic effects simulations. 

In this case, at 30 GHz the null spectra from the data exceed 
the predictions from both the noise Monte Carlo and the sys¬ 
tematic effects simulations that assume a perfect subtraction of 
straylight effects. This is true particularly for the spectra in tem- 
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Fig. 19: Maps of the effect from 1-Hz spikes. Rows correspond to 30, 44, and 70 GHz channels, while columns correspond to /, Q , 
and U. Maps are smoothed to the beam optical resolution of each channel (#fwhm = 33', 28', and 13', respectively). 


perature. Some excess in temperature is present also at 44 and 
70 GHz. 

These results give useful hints on the accuracy of the opti¬ 
cal model of the LFI sidelobes used to estimate the straylight 
contribution. In this respect we are planning further studies to 
improve this model exploiting the information provided by these 
null tests. The outcome of these studies will be reported in the 
context of the next Planck release. 

3.4. Impact of systematic effects at large angular scales 

In this section we describe the assessment of systematic effect 
uncertainties on the detection of optical depth, r, from LFI data 
at large angular scales. For the Planck 2015 release the extrac¬ 
tion of the r parameter is based on the LFI 70 GHz data, using 
the LFI 30 GHz channel for removing polarized foreground syn¬ 
chrotron and the HFI 353 GHz channel to clean polarized dust 
emission (Planck Collaboration XI 2016; Planck Collaboration 
XIII 2016). 

To quantify the impact of residual effects on r, we carried 
out an end-to-end analysis, propagating the simulated effects to 
maps, power spectra, and parameters, following the same pro¬ 
cessing steps adopted in the data analysis. We start from the map 
containing the sum of all the systematic effects at 70 GHz in po¬ 
larization, add to it a realization of white noise and 1 // noise de¬ 
rived from FFP8 simulations for the full mission, and finally add 
a CMB realization. The corresponding map at 30 GHz is used 
in the template-fitting procedure to quantify its impact on the 


synchrotron removal process. Here we neglect the propagation 
of systematic effects from the 353 GHz channel. However, we 
expect a very small contribution from this channel considering 
the expected level of systematic effects (see section 7 of Planck 
Collaboration VIII 2016) and the scaling coefficient for dust be¬ 
tween 353 and 70 GHz, « 0.0077 (Planck Collaboration XI 
2016, section 2.3). 

In more detail, we consider the linear combination m c i ean = 
m 7 o - <rm 3 o, where a = 0.063 is the effective synchrotron scal¬ 
ing ratio between the 30 and 70 GHz channels, and adjust the 
effective noise covariance matrix accordingly (see Planck Col¬ 
laboration XI 2016, for a more detailed discussion). In practice, 
this is equivalent to assuming that our cleaning procedure leaves 
no foreground residual in the final map, and for the scope of 
this analysis we only need to consider the impact of the rescaled 
30 GHz noise and residual effects on the foreground-cleaned 
map. 

From the resulting foreground-cleaned map, we extract the 
power spectra for the temperature and polarization components 
at multipoles € < 29. We calculate the spectra over the sky region 
used to derive r, shown in the bottom panel of Fig. 5. 

To quantify the result, we calculate the bias introduced by the 
systematic effects on the three parameters that are most sensitive 
to low multipoles, i.e., r, r, and the amplitude of scalar pertur¬ 
bations, A s . We produce 1000 Monte Carlo FFP8 simulations of 
the CMB polarized sky plus white and 1 // noise with systematic 
effects, and 1000 similar simulations but containing only CMB 
and noise. For each realization we then calculate the marginal- 
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Fig. 20: Angular power spectra of full - year maps. Colored lines represent the four nulls obtained from data and simulations of the effects listed in Table 2. The purple colored 
area represents the envelope from Monte Carlo simulations as described in the text. In this figure we can appreciate that the power spectra of the data from the null maps are 
well matched by noise, except for a few low-^ points at 30 GHz. Furthermore, the power spectra of the simulated systematic effects fall well below the data at all but the lowest £ 
values. 
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area represents the envelope from Monte Carlo simulations as described in the text. 
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Fig. 22: Angular power spectra of consecutive survey difference maps. Colored lines represent the four nulls obtained from data and simulations of the effects listed in Table 2. 
The colored area represents the envelope from Monte Carlo simulations as described in the text. 
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ized distributions for each of the three parameters X = r, r, A s 
and calculate the differences AX = X syst . - X no - sys t., which repre¬ 
sent the bias introduced in the estimates of X by the combination 
of all systematic effects. 

For log(A s ) and r we find median bias values of -0.026 and 
0 .11, respectively, which would correspond to a 0.2 cr effect on 
the amplitude parameter and an increase of 15% on the up¬ 
per limit on r (95% CL). However, the dominant Planck con¬ 
straints on these two parameters come effectively from tempera¬ 
ture power spectrum at high multipoles, so the actual impact on 
the Planck results is very small. 

For the optical depth, we find a mean bias (At) = 0.005, or 
0.2-0.25 times the standard deviation of the value of r measured 
by LFI (Planck Collaboration XIII 2016). This result shows that 
the impact of all systematic effects on the measurement of r is 
within lcr. The measured (At) is compatible with a positive but 
sub-dominant bias by residual systematics, with an impact on t 
well within the statistical uncertainty. 

We emphasize that this result is based on our bottom-up ap¬ 
proach, and therefore it relies on the accuracy and completeness 
of our model of all known instrumental systematic effects. As we 
have shown, at large angular scales systematics residuals from 
our model are only marginally dominated by the EE polarized 
CMB signal. For this reason we plan to produce a further inde¬ 
pendent tests on these data based both on null tests and on cross¬ 
spectra between the 70 GHz map and the HFI 100 and 143 GHz 
maps. Such a cross-instrument approach may prove particularly 
effective, because we expect that systematic effects between the 
two Planck instruments are largely uncorrelated. We will dis¬ 
cuss these analyses in a forthcoming paper in combination with 
the release of the low-ell HFI polarization data at 100-217 GHz 
and in the final 2016 Planck release. 

3.5. Propagation of systematic effects through component 
separation 

In this section we discuss how we assess the impact of residual 
systematic effects in the LFI data on the CMB power spectra 
after component separation (see Fig. 27 in Sect. 4). 

Planck component separation exploits a set of algorithms to 
derive each individual sky emission component. They are mini¬ 
mum variance in the needlet domain (NILC) or use foreground 
templates generally based on differences between two Planck 
maps that are close in frequency (SEVEM), as well as paramet¬ 
ric fitting conducted in the pixel (Commander) and harmonic 
(SMICA) domains. We describe them in detail in Planck Collab¬ 
oration IX (2016). 

To assess residuals after component separation we use LFI 
systematic effect maps as the input for a given algorithm, setting 
the HFI channels to zero. This means that the output represents 
only the LFI systematic uncertainty in the corresponding CMB 
reconstruction. In Planck Collaboration III (2014) we exploited 
a global minimum-variance component-separation implementa¬ 
tion, AltICA, to derive weights used to combine the LFI sys¬ 
tematic effect maps. Here we generalize the same procedure us¬ 
ing NILC and SEVEM. Both are based on minimum-variance es¬ 
timation of the weights, but in localized spatial and harmonic 
domains, and so optimally subtract foregrounds where they are 
most relevant (NILC), and exploit foreground templates gener¬ 
ally constructed by diffferencing two nearby Planck frequency 
channels (SEVEM). 

Fig. 23 shows maps in total intensity and polarization of 
the LFI systematic effects after component separation. Maps ex¬ 
tracted with NILC appear in the top row, while maps extracted 


with SEVEM appear in the bottom row. The structures that are 
most prominent outside the Galactic residuals appear to be asso¬ 
ciated with the scan strategy. Residuals are about 5 times larger 
for NILC than for SEVEM, for the reasons described in Sect. 4. 
It is important to stress that component separation does not al¬ 
ter the relative strength of the various systmatic effects treated in 
this paper, but simply filters them through the given foreground¬ 
cleaning pipeline. 

Fig. 27 in Sect. 4 shows power spectra obtained from these 
maps compared with the best-fit Planck 2015 ACDM cosmol¬ 
ogy. To calculate these spectra we have first applied the masks 
shown in Fig. 5 and then computed pseudo-spectra corrected for 
the unseen sky fraction. 

In total intensity we confirm the results presented in Planck 
Collaboration III (2014): the impact of known LFI systematic 
effects is at least two orders of magnitude less than the CMB. 
In polarization we observe a different residual level, depending 
on the algorithm used. The weighting strategy of NILC at large 
angular scales performed in the needlet domain yields a resid¬ 
ual effect that is larger by about 1.5 orders of magnitude com¬ 
pared to SEVEM. We further discuss this discrepancy in Sect. 4. 
The 70-GHz channel is one with less foreground contamination 
and higher angular resolution. Hence, NILC weights this chan¬ 
nel more compared to the others. This ultimately causes a larger 
level of residual systematic effects. 

The residual effect in polarization after processing with NILC 
is comparable to interesting levels of cosmological 5-modes at 
large scales. This particular point needs further attention for 
the next Planck data release, where component-separation solu¬ 
tions will be relevant for characterizing polarization accurately 
at large angular scales. 

3.6. Gaussianity statitical tests 

In this section we present the results of statistical tests assessing 
the impact of known systematic effects in the LFI data on non- 
Gaussianity studies. 

The presence of systematic effect residuals can bias the sta¬ 
tistical isotropy properties of the Planck maps (Planck Col¬ 
laboration XVI 2016) or the constraints on primordial non- 
Gaussianity (Planck Collaboration XVII 2016). Therefore it is 
important to understand the impact of known systematic effects 
on the most relevant non-Gaussianity studies carried out within 
this release. 

In the Planck 2013 release the non-Gaussianity studies were 
carried out using temperature data in two steps (Planck Collabo¬ 
ration III 2014). Firstly, we estimated an upper limit on the “de¬ 
tectability level” of all the known effects summed into a single 
“global” map. This level was defined as the factor we must mul¬ 
tiply the global map by to generate a significant non-Gaussian 
deviation. Secondly, we measured the bias that these systematic 
effects could introduce on the local nonlinear coupling /nl pa¬ 
rameter. 

In the current release we follow the same approach, consid¬ 
ering, additionally, the polarization signal at low £. We have also 
considered the three usual cases (namely local, equilateral, and 
orthogonal) for the bispectrum shape when defining / NL . 

We characterize the level of detectability of the non- 
Gaussian contamination by comparing simulations that contain 
the systematic effect map added and rescaled by a global fac¬ 
tor, / sys , with the null hypothesis (i.e., no systematic effects). We 
consider two scenarios, measuring the level of detectability of 
the systematic effects over: (i) the CMB + noise background; 
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Fig. 23: Maps in total intensity and polarization of the LFI systematic effects after component separation. Top : maps extracted with 
NILC. Bottom', maps extracted with SEVEM. Notice that the colour scale of SEVEM maps is 5 times smaller than that of NILC maps. 


and (ii) the noise background only. These can be written 

Ar (i) (n) = Ar C MB(n) + A7’ n0 i S e(n) + / S y ) s Ar sys (n), (2) 
Alfli) (n) = ATjoise (n) + f^AT sys (n). (3) 

For each case we calculate the detectability factor using a^ 2 
test on Monte Carlo simulations. First we produce two sets of 
1000 simulations with and without the systematic effects added 
and then we define^ 2 = VC -1 V T . The vector V can be V = [T], 
V = [Q,U], or V = [T , Q, U], while C is the corresponding co- 
variance matrix. Under the assumption of normality, this statis¬ 
tics follow 3.x 2 distribution with Nt, Nq + Njj or Nj + Nq + Njj 
degrees of freedom, respectively. 14 This is one of the estimators 
used in the Gaussianity analyses of Planck Collaboration XVI 
(2016). 

To define the “detectability factors” and we con¬ 
sider a method to discriminate two^ 2 histograms corresponding 
to simulations with and without systematic contamination. We 
use the common choice based on the significance level of the 
two histograms, defined as the fraction of cases of the null hy¬ 
pothesis (no systematic effects added) with a x 2 larger than the 
median of the alternative hypothesis (systematic effects added). 
Both distributions are considered different when this number is 
lower than 5 %. Therefore / s ( y S and are defined as the global 
scaling factor of the systematic map that is necessary to detect 
non-Gaussianity deviations with 95 % confidence. 

We measure the levels of detectability, reported in Table 3, 
for temperature and polarization maps at low resolution (f max = 
95). For temperature-only we obtain / s ( y S = 16.34, 9.06, and 
12.98 for 30,44, and 70 GHz, respectively. These values are con¬ 
sistent with those obtained in the previous release (Planck Col¬ 
laboration III 2014). Including polarization results in lower lev¬ 
els being detectable for both cases (CMB plus noise and noise- 
only backgrounds). The values found are / s ( y S > 0.73, 1.25, and 

14 Nt, Nq, and Nu are the total number of pixels available for the T, Q , 
and U maps, respectively. 


Table 3: Level of detectability of non-Gaussianity caused by 
simulated systematic effects in the LFI maps. Numbers with¬ 
out parenthesis correspond to the case of CMB plus noise back¬ 
ground, / S yg, and numbers in brackets correspond to the case of 
the noise background, (/ S ys). 



30 GHz 

44 GHz 

70 GHz 

I . 

. 16.34(0.52) 

9.06(1.72) 

12.98 (0.78) 

Q,u . 

. 0.73 (0.55) 

1.25 (1.00) 

1.89 (1.54) 

I,Q,U . 

. 0.74(0.44) 

1.30 (0.98) 

1.92 (0.91) 

Table 4: Relative variation A/ N l/ct(/nl) as a percentage, caused 
by simulated systematic effects in the LFI data. 


30 GHz 

44 GHz 

70 GHz 

Local. 

. -0.90 

-0.01 

-0.05 

Equilateral. . 

. 1.80 

0.02 

0.02 

Orthogonal . 

. 2.22 

0.02 

0.06 


1.81 for 30, 44, and 70 GHz, respectively. If we consider only 
the noise background the values decrease for all the cases (see 
Table 3). The level of detectability for the 70 GHz channel in 
the CMB plus noise background case is always larger than the 
critical limit of / s ( y S = 1. This is the case that is particularly rele¬ 
vant for non-Gaussianity tests (Planck Collaboration XVI 2016; 
Planck Collaboration XVII 2016). 

The second aspect on non-Gaussianity we have consid¬ 
ered is the impact of systematic effects on the primordial non- 
Gaussianity /nl parameter. We define the bias on this param¬ 
eter, A/nl, as the mean difference between the two /nl val- 
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ues measured in maps with and without systematic effects, i.e., 

a -C — /-sys /-clean 
A/nl - j NL j NL . 

To obtain a limit on this bias, we have first computed the full- 
sky bispectrum of the global systematic effect maps, following 
the formalism of Komatsu et al. (2002), and then we have cross- 
correlated it with the primordial bispectrum. We removed the 
bias generated by extragalactic point sources or the CIB-lensing, 
following the procedure described, e.g., in Curto et al. (2013, 
2014). 

Table 4 shows the values of the bias A/nl calculated at high 
resolution (^ max = 1024) for the LFI channels. The bias is nor¬ 
malized to the corresponding dispersion of /nl to estimate the 
relative impact on the measurement of this parameter. For the 
three LFI channels, the impact of systematic effects on /nl is 
negligible, being lower than 0.90% for the local shape, 1.80% 
for the equilateral shape and 2.22 % for the orthogonal shape. 
The 30 GHz channel has the highest amplitude for this bias, 
whereas the 44 and 70 GHz channels have maximum amplitudes 
of 0.02 % and 0.03 %, respectively. 


4. Summary of uncertainties due to systematic 
effects 

This section provides a top-level overview of the residual 15 un¬ 
certainties in the Planck -LFI CMB maps and power spectra, in¬ 
troduced by systematic effects. We list these effects in Table 1 
and summarize the main results of our analysis, which are dis¬ 
cussed in Sect. 3 and corresponding subsections. 

Tables 5, 6, and 7 report the peak-to-peak 16 and rms sys¬ 
tematic effect uncertainties in LFI maps. To calculate these un¬ 
certainties we have used HEALPix (Gorski et al. 2005) maps 
with simulated systematic effects degraded to = 128 (cor¬ 
responding to a pixel size of around 28') at 30 and 44 GHz, 
and Afside = 256 (corresponding to a pixel size of about 14') at 
70 GHz. This pixel sizes approximate the optical beam angular 
resolution. Maps were masked with the top and middle masks 
shown in Fig. 5, also used for power spectra estimation. 

The rms uncertainty in LFI maps from known systematic ef¬ 
fects is ^ 0.5 /a K in polarization and ^ 1 yuK in temperature. The 
improvements 17 introduced into the LFI pipeline have allowed 
us to reduce the peak-to-peak uncertainty by a factor ranging 
from 3.5 at 70 GHz to 7.7 at 30 GHz, compared to the 2013 
analysis (Planck Collaboration III 2014). At 30 and 70 GHz cal¬ 
ibration and analogue-to-digital converter (ADC) nonlinearity 
are the prevailing effects, while at 44 GHz calibration and 1-Hz 
spikes dominate. 

In our assessment we have not included the residual effects 
from far sidelobes, because we remove Galactic stray light di¬ 
rectly from the timelines. This removal is based on optical sim¬ 
ulations, which implies that a residual effect may be present in 
the data. Estimating this remaining signal is complex and com¬ 
putationally demanding, since it requires us to generate Monte 
Carlo simulations of the far sidelobes. For the present analysis 
we have used the following approach regarding far sidelobes: 
we have assessed the impact of systematic effects assuming the 
perfect removal of Galactic straylight; and additionally we have 


15 We use the word “residual” to refer to the spurious signal remaining 
in the final LFI maps due to a systematic effect, that is after any removal 
steps applied by the data analysis pipeline. 

16 In this paper we call “peak-to-peak” the difference between the 99% 
and the 1% quantiles of the pixel value distributions. 

17 See Sects. 4, 6, and 7 of Planck Collaboration II (2016) 


Table 5: Summary of systematic effect uncertainties on 30 GHz 
maps a in juKcmb- Columns give the peak-to-peak (“p-p”) and 
rms levels for Stokes /, Q , and U maps. 



i 

r 


Q 

U 


P-P 

rms 

P-P 

rms 

P-P 

rms 

Near sidelobes. 

. 0.72 

0.13 

0.05 

0.01 

0.05 

0.01 

Pointing . 

. 0.37 

0.07 

0.02 

0.01 

0.02 

0.00 

Polarization angle . . . 

. 0.02 

0.00 

0.53 

0.11 

0.64 

0.15 

1-Hz spikes. 

. 0.54 

0.11 

0.11 

0.02 

0.09 

0.02 

Bias fluctuations .... 

. 0.07 

0.01 

0.07 

0.01 

0.06 

0.01 

ADC nonlinearity.... 

. 0.42 

0.09 

0.54 

0.11 

0.56 

0.11 

Calibration. 

. 2.43 

0.55 

2.53 

0.46 

2.34 

0.43 

Thermal fluct. (300 K) 

. 0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Thermal fluct. (20 K) . 

. 0.12 

0.03 

0.06 

0.02 

0.06 

0.02 

Thermal fluct. (4 K) . . 

. 0.29 

0.06 

0.06 

0.01 

0.05 

0.01 

Total b . 

. 2.72 

0.61 

2.79 

0.52 

2.42 

0.49 


a Calculated for a pixel size approximately equal to the average beam 
FWHM. A null value indicates a residual < 10 -2 yuK CMB . 
b The total has been computed on maps resulting from the sum of indi¬ 
vidual systematic effect maps. 

Table 6: Summary of systematic effect uncertainties on 44 GHz 
maps in juKcmb- Columns give the peak-to-peak (“p-p”) and rms 
levels for Stokes /, Q , and U maps. 




I 

Q 


U 


P-P 

rms 

P-P 

rms 

P-P 

rms 

Near sidelobes. 

. 0.09 

0.02 

0.00 

0.00 

0.00 

0.00 

Pointing . 

. 0.30 

0.06 

0.01 

0.00 

0.01 

0.00 

Polarization angle . . . 

. 0.04 

0.01 

0.35 

0.07 

0.38 

0.10 

1-Hz spikes. 

. 1.99 

0.40 

0.88 

0.18 

1.04 

0.21 

Bias fluctuations .... 

. 0.04 

0.01 

0.05 

0.01 

0.05 

0.01 

ADC nonlinearity.... 

. 0.30 

0.06 

0.36 

0.07 

0.34 

0.07 

Calibration. 

. 1.05 

0.18 

1.57 

0.29 

1.31 

0.26 

Thermal fluct. (300 K) 

. 0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Thermal fluct. (20 K) . 

. 0.04 

0.02 

0.06 

0.01 

0.05 

0.01 

Thermal fluct. (4 K) 

. 0.23 

0.05 

0.05 

0.01 

0.06 

0.01 

Total. 

. 2.29 

0.45 

1.95 

0.37 

1.76 

0.37 


quantified how much the far sidelobes would affect our results if 
they were not removed at all. 

Figures 24, 25, and 26 provide an overview of the power 
spectra in temperature and polarization for each systematic ef¬ 
fect, compared to the foreground levels at 30 GHz and to the 
cosmological signal at 44 and 70 GHz. At 30 GHz we use the 
spectrum obtained from measured data as an approximation of 
the foreground spectrum at this frequency. At 44 and 70 GHz we 
use the power spectrum coming from the best fits to the Planck 
cosmological parameters (see figures 9 and 10 in Planck Collab- 


Article number, page 25 of 33 



























A&A proofs: manuscript no. Planck2014_systematics 


Table 7: Summary of systematic effect uncertainties on 70 GHz 
maps in //Kcmb- Columns give the peak-to-peak (“p-p”) and rms 
levels for Stokes /, Q , and U maps. 



i 

f 


Q 


U 


P-P 

rms 

P-P 

rms 

P-P 

rms 

Near sidelobes. 

. 0.30 

0.07 

0.01 

0.00 

0.01 

0.00 

Pointing . 

. 0.60 

0.11 

0.03 

0.01 

0.03 

0.01 

Polarization angle . . . 

. 0.02 

0.00 

0.08 

0.02 

0.08 

0.02 

1-Hz spikes. 

. 0.39 

0.08 

0.17 

0.03 

0.15 

0.03 

Bias fluctuations .... 

. 0.68 

0.14 

0.84 

0.17 

0.95 

0.18 

ADC nonlinearity.... 

. 1.56 

0.33 

1.92 

0.39 

2.05 

0.41 

Calibration . 

. 1.06 

0.23 

0.98 

0.18 

0.77 

0.16 

Thermal fluct. (300 K) 

. 0.00 

0.00 

0.00 

0.00 

0.00 

0.00 

Thermal fluct. (20 K) . 

. 0.44 

0.08 

0.07 

0.01 

0.08 

0.02 

Thermal fluct. (4K) 

. 0.38 

0.08 

0.04 

0.01 

0.05 

0.01 

Total. 

. 2.24 

0.47 

2.27 

0.46 

2.38 

0.48 


oration I 2016) filtered by the LFI window functions. The exam¬ 
ple CMB 5-mode spectrum is based on Planck -derived cosmo¬ 
logical parameters and assumes a tensor-to-scalar ratio r - 0.1, a 
tensor spectral index nj - 0, and no beam-filtering. Instrumental 
noise here is based on “half-ring” difference maps, as described 
in sections 12.1 and 12.2 of Planck Collaboration II (2016). 

In the same figure we also show the power spectra of Galactic 
stray light detected by the far sidelobes (the dotted green lines), 
which indicate the level of the effect that we expect to have re¬ 
moved from the data. 

At 30 GHz the systematic effects are all lower than the fore¬ 
ground signal. The Galactic stray light is higher than the noise 
level at t ^ 20. For this reason we removed an estimate of Galac¬ 
tic stray light from the timelines, based on our best knowledge of 
the far sidelobes. These results show that the 30 GHz channel 
gives a reliable foreground template, with uncertainties set by 
the instrumental noise. 

At 44 and 70 GHz the level of Galactic stray light is lower 
than the CMB. It is reasonable to assume that any residual that 
could be present in the data must be less than the total effect 
reported here and, therefore, negligible compared to the CMB. 

The power spectrum of the sum of all systematic effects 
(dark-grey line) is higher than the 5-mode spectrum in the t 
range 10-15 and is marginally below that for multipoles < 10, at 
both 44 and 70 GHz. This could have an impact on the extraction 
of the optical depth, r, which is strongly dependent on the C EE 
spectrum at very low fs. 

We have evaluated the impact of the simulated effects on r 
(see Sect. 3.4) and found a bias that is about 0.2 times the stan¬ 
dard deviation, showing that the uncertainty on this parameter 
is dominated by statistics and the contribution from systematic 
effects is only of marginal importance. 

We have also assessed the uncertainty caused by LFI system¬ 
atic effects on the CMB power spectra estimated by Planck after 
component separation. 

In our procedure (described in Sect. 3.5) we set the HFI 
channels to zero to evaluate the systematic uncertainty of LFI 
only in the CMB reconstruction. It is a generalization of the ap¬ 


proach described in Planck Collaboration III (2014), based on 
component-separation weights calculated via minimum variance 
over the whole sky area considered. In this test we first input 
maps with the sum of all systematic effects into the component 
separation pipeline, then we apply the top and middle mask in 
Fig. 5 to the resulting maps and, finally, we calculate the pseudo¬ 
spectra. 

Figure 27 shows the angular power spectra of the sum of 
all known LFI systematic effects in the component-separation 
outputs of the NILC and SEVEM algorithms described in Planck 
Collaboration IX (2016). These plots highlight the level of the 
residual effects compared with the Planck 2015 best-fit cosmol¬ 
ogy. 

The results in total intensity confirm the findings of our pre¬ 
vious data release. The residual systematic effects are several 
orders of magnitude lower than the CMB power spectrum at all 
angular scales. 

The results in polarization show that the residual effects re¬ 
sulting after the application of the SEVEM algorithm are about 
1.5-2 orders of magnitude lower than those resulting from NILC, 
at all angular scales. This means that the residual effects obtained 
with NILC have an amplitude comparable to cosmological B- 
modes with r ~ 0.1. 

The reason for this discrepancy in the component-separated 
outputs is the different weighting that the two codes apply to the 
LFI channels. In NILC the LFI channels are weighted more than 
in SEVEM, which also implies a larger impact of the systematic 
effects. Let us recall the reasons for this different weighting. 

NILC implements a minimum variance approach in the 
needlet domain, and produces a set of weights for each Aband 
in which it is applied. For this reason, in the LFI channels the 
weights are particularly relevant at large angular scales, where 
foregrounds are most important. 

SEVEM, on the other hand, applies a smoothing to the LFI 
channels and then calculates the minimum variance coefficients 
over the entire range of multipoles, which eventually results in 
smaller weights for the LFI channels and, therefore, a smaller 
contribution of their systematic effects. 

5. Conclusions 

This is the era of precision cosmology. The advances in detector 
and space technology in the last 20 years now allow us to test 
theories describing the evolution of the Universe with statistical 
uncertainties that were unimaginable at the time the CMB was 
discovered, more than 50 years ago. 

Planck has produced the most sensitive full-sky maps of the 
microwave sky to date. We have exploited its unprecedented sta¬ 
tistical power to obtain the most precise angular temperature 
power spectrum of the CMB (Planck Collaboration XI 2016), as 
well as cosmological parameters with relative errors below the 
percent level in some cases (Planck Collaboration XIII 2016). 

In the last ten years several experiments from the ground and 
the stratosphere have successfully tested new technologies that 
are further increasing sensitivity and opening new frontiers for 
cosmology by exploiting measurements of the CMB anisotropy 
polarization. 

However, precision is nothing without accuracy. Understand¬ 
ing and controlling systematic uncertainties is one of the great¬ 
est challenges for present and future measurements of the CMB. 
The control of systematic effects has indeed been a challenge for 
Planck , both in the development phase and during data analysis. 

In this paper we have discussed the systematic effect uncer¬ 
tainties of the Planck Low Frequency Instrument data in the con- 
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noise from half-ring (HR) difference maps. The CMB TT and EE spectra are best fits to the Planck cosmological parameters (see figures 9 and 10 in Planck Collaboration 12016) 
filtered by the LFI window functions. The example CMB 5-mode spectrum is based on 5/a^c^-derived cosmological parameters and assumes a tensor-to-scalar ratio r = 0.1, a 
tensor spectral index nj = 0, and no beam-filtering. The thick dark-grey line represents the total contribution. The dotted dark-green line is the contribution from the far sidelobes 
that has been removed from the data and is therefore not considered in the total. 
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half-ring (HR) difference maps. The CMB TT and EE spectra are best fits to the Planck cosmological parameters (see figures 9 and 10 in Planck Collaboration I 2016) filtered 
by the LFI window functions. The example CMB 5-mode spectrum is based on 5/a^c^-derived cosmological parameters and assumes a tensor-to-scalar ratio r = 0.1, a tensor 
spectral index nj = 0, and no beam-filtering. The thick dark-grey line represents the total contribution. The dotted dark-green line is the contribution from far the sidelobes that 
has been removed from the data and is therefore not considered in the total. 
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half-ring (HR) difference maps. The CMB TT and EE spectra are best fits to the Planck cosmological parameters (see figures 9 and 10 in Planck Collaboration I 2016) filtered 
by the LFI window functions. The example CMB 5-mode spectrum is based on 5/a^c^-derived cosmological parameters and assumes a tensor-to-scalar ratio r = 0.1, a tensor 
spectral index nj = 0, and no beam-filtering. The thick dark-grey line represents the total contribution. The dotted dark-green line is the contribution from far the sidelobes that 
has been removed from the data and is therefore not considered in the total. 
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Fig. 27: Angular power spectra for the combined LFI systematic effects templates in the CMB TT , EE , and BB reconstructions of 
the NILC and SEVEM pipelines, compared with the Planck fiducial cosmology. 


text of the second cosmological data release. This is the result of 
work begun almost 20 years ago, when we started developing 
the instrument with systematic effects control as one of the main 
drivers for the instrument and data-analysis pipeline designs. 
Our approach follows two complementary paths. 

- The first uses measured data and exploits the redundancy in 
the scanning strategy to divide the observations into peri¬ 
ods of various length in which the observed sky is the same. 
We used the analysis of difference maps constructed on such 
periods (“null tests”) to highlight possible spurious residual 
signals exceeding the instrumental noise. 

- the second uses our knowledge of the instrument to build 
physical models of the various known systematic effects that 
are simulated from timelines to maps. Here we exploit, as 
much as possible, actual flight measurements, such as point¬ 
ing, temperatures, and radiometric data. 

We use simulations to quantify the uncertainties introduced 
by systematic effects in the maps and power spectra, and com¬ 
pare our predictions with null-test results to identify residuals 
that are not accounted for by our model. We also use our sim¬ 
ulations to assess the impact of these effects on cosmological 
parameters (like the reionization optical depth, r) on the mea¬ 
surements of the CMB statistical properties, and on component 
separation. 

Our results for temperature data confirm the findings of the 
first Planck release (Planck Collaboration III 2014): the mea¬ 
surements are limited by instrumental noise and at all relevant 
angular scales the systematic effects are several orders of mag¬ 
nitude below the power spectrum of the CMB itself. 

Our analysis for polarization demonstrates the robustness of 
the LFI data for scientific analysis, in particular regarding the 
measurement of r and the statistical analysis of CMB maps. Sys¬ 
tematic effects, however, are more challenging in polarization 
than in temperature and their level is close to the E -mode signal, 
especially at large angular scales. 

Uncertainties in the relative photometric calibrations domi¬ 
nate the LFI systematic effects budget, especially at large angu¬ 


lar scales. This is an area in the data analysis pipeline that is still 
being improved in preparation for the next Planck release. 

Our data could also contain residual Galactic straylight 
caused by an imperfect knowledge of the beam sidelobes. We 
do not consider this residual in our budget, but null spectra from 
consecutive surveys indicate a possible presence of such a spuri¬ 
ous signal at 30 GHz. 

At 70 GHz the systematic effects compete with the CMB E- 
modes for multipoles in the range 10-20. This does not preclude 
an accurate measurement of r, which depends mainly on multi¬ 
poles f < 10 (Planck Collaboration XI 2016). Using systematic 
effects simulations we have shown that the bias introduced on 
r is less than 0.25 times the standard deviation of the measured 
parameter. Forthcoming analyses will include independent esti¬ 
mations, based on null tests and on cross-correlation between the 
LFI 70 GHz map and the HFI 100 and 143 GHz maps. 

We have also evaluated the impact on the scalar perturba¬ 
tions amplitude, ln(A s ), and on the upper limit to the tensor-to- 
scalar ratio, r, derived with large-scale polarization data. In this 
case the effect on ln(A s ) is approximately 0.2 <x, while the upper 
limit on r is increased by the systematic effects by around 15%. 
For these two parameters, however, the main Planck constraint 
comes from the temperature power spectrum at high multipoles, 
so that the actual impact is negligible. 

At 30 GHz the systematic effects are much smaller than the 
Galactic emission at all multipoles. We use this channel as a fore¬ 
ground monitor, which implies that we are not limited by sys¬ 
tematic effects at this frequency for any angular scale, in either 
temperature or polarization. 

The 44 GHz channel displays residuals that compete with the 
£-mode polarization for £ < 10 and dominate the signal for mul¬ 
tipoles in the range 10-20. We do not use this channel in the cur¬ 
rent polarization analysis, so these effects do not play a role in 
the measurement of r. We use the 44 GHz data, however, in the 
component separation analysis. 

The contribution of LFI systematic effects on CMB maps 
and power spectra after component separation is smaller than the 
CMB signal at all scales, both in temperature and polarization. 
We have assessed this using two component separation codes, 
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namely NILC (a minimum variance code in the needlet domain) 
and SEVEM (a code based on foreground templates). With both 
codes the LFI systematic uncertainties do not limit accurate mea¬ 
surement of the CMB temperature and polarization spectra. As 
expected, we find that the use of SEVEM results in a lower level of 
residuals compared to NILC, because of the different weighting 
of the LFI data applied by the two codes. 

The presence of known systematic effects in the LFI data 
does not significantly impact non-Gaussianity studies. We have 
used maps with the simulated effects combined with CMB and 
noise maps and found that, at 70 GHz, the amplitude of these ef¬ 
fects must be at least a factor of 2 larger to detect a significant 
non-Gaussianity. We have also assessed the bias on the /nl pa¬ 
rameter and found that it is less than 0.1 % at 44 and 70 GHz and 
<2.2% at 30 GHz. 

Finally, we comment about the systematic uncertainties on 
the #-mode polarization measurements. Our analysis shows that 
at 70 GHz the level of systematic effects is smaller than the in¬ 
strumental noise, but larger than a 5-mode power spectrum for 
r = 0.1. This does not impact our polarization analysis, based on 
5-mode polarization data, but shows, once again, the importance 
of understanding and controlling systematic effects in future ex¬ 
periments aiming at the detection of this elusive signal. 

Understanding and controlling systematic effects in the LFI 
data has been a challenge from which we have gained even 
deeper knowledge of our instrument and learned several valu¬ 
able lessons for the future. This is a future destined to be one 
of even more precise and accurate cosmology, but also one of 
increasing challenge to control systematics effects, 
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